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ABSTRACT 

We use the deep NIR imaging of the FIRES survey to investigate trends with redshift of the properties 
of galaxies selected to have strong Balmer/4000 A breaks at 2 < z < 4.5. Analagous to the J—K > 1.3 
(AB) color criterion designed to select red galaxies at z > 2, we propose two color criteria, J — H > 0.9 
and H — K > 0.9, to select red galaxies in two redshift bins at 2 < z < 3 and 3 < z < 4.5, respectively. 
From the FIRES catalogs of the HDF-S (4.7 arcmin 2 ) and MS 1054-03 (26.3 arcmin 2 ) fields, we find 
18 galaxies with (z p hot) = 2.4 that satisfy J s — H > 0.9; H < 23.4 and 23 galaxies with (z p hot) = 3.7 
that satisfy H — K s > 0.9; K s < 24.6, where the flux limits are chosen to match the limiting rest-frame 
luminosities at the different median redshifts of the two samples. The space densities of the J s — H 
and H — K s samples are 1.5 ± 0.5 x 10~ 4 and 1.2 ± 0.4 x 10~ 4 Mpc~ 3 , respectively. The rest-frame 
U — B colors of galaxies in both samples are similarly red (as expected from the definition of the color 
criteria), but the rest-frame UV properties are different: galaxies in the higher- redshift H — K s selected 
sample have blue NUV-optical colors and UV slopes similar to those of Lyman Break Galaxies, while 
the J s — H galaxies are generally red over the entire wavelength range observed. Synthetic template 
fits indicate that the distinct rest-NUV properties of the two samples are primarily a result of dust: 



we find {Ay) 



JH 



1 mag and (Ay) 



HK 



0.2 mag. The median stellar mass determined from the 



template fits decreases by a factor of ~ 5 from z = 2.4 to 3.7, which, coupled with the fact that the 
space density of such galaxies remains roughly constant, may imply that the stellar mass density in 
red galaxies decreases by a similar factor over this redshift range. 

Subject headings: cosmology: observations — galaxies: evolution — galaxies: formation 
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1. INTRODUCTION 

Over the last few years, the study of galaxies with 
red rest-frame optical colors has been extended to ever- 
increasing redshifts. While the selection of galaxies 
based on their rest-f rame UV emission (e.g. the Ly- 
man break technique; ISteidel fc~H amiltor3 ll993l ) has en- 
abled the detailed study of young galaxies at high red- 
shift for some time, it is only with the more recent ad- 
vent of efficient, large-scale detectors in the near-IR that 
large numbers of galaxies with redder rest- frame colors 
have been discovered at early c osmic epochs (|Franx et al.l 
120031 Ivan Dokkum et alJl2003[ ). Red galaxies with typi- 
cally very low UV fluxes make up 80 % of the mass con- 
taine d in the most massive galaxies (|van Dokkum et al.l 
l2006f) and 25-75% of the total mass in galaxies a t 2 < 
z < 3 (jPapovich et al.ll2006t iMarchesini et al.ll2006l) . and 
thus provide critical constraints o n theoretical models of 
galaxy formation and evolution (|Somerville et a.1.1 l2004t 
iNagamine et al.ll2005| ). 

A proven technique for selecting galaxies with red 
rest- frame optical color s is the J s — K s > 1.3 crite- 
rion (J — if vega > 2.3; iFranx et al.ll2003f ). which relies 
on the Balmer/4000 A break redshifted into the J band 
for redshifts z > 2. Galaxies selected using this tech- 
nique comprise a heterogeneous population showing a 
broad range in dust proper ties, luminosity- weighted ages , 
and star-formation rates (|Forster-Schreiber et al.l 120041: 
Labbe et al.l 120051 : iPapovich et alJ 120061 : iKriek et al I 
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ies to redshifts z > 3, and we compare the number 
and properties of red galaxies at z ~ 3.5 to those at 
z ~ 2.5 using uniform color selection criteria based on 
the Balmer/4000 A break redshifted into the H and J s 
bands, respectively. While there is typically a tail of 
sources e xtending beyond z > 3.5 in J — K selected sam- 
ples (e.g. IForster-Schreiber et aT]|2004h . there have been 
no systematic studies comparing the numbers and prop- 
erties of red galaxies at the extremes of the broad J — K 
redshift selection window. We adopt Ho — 70 km/s, 
ft m = 0.3, and ft a = 0.7. All magnitudes are given in 
the AB system. 

2. COLOR SELECTION OF RED GALAXIES 

The top panel of Fig . [l]show s the observed J s —K s color 
of iBruzual fc Charlotl (|2003h template spectra over < 
z < 5. At a given redshift, J s — K s is reddest for the old- 
est template because the strength of the Balmer/4000 A 
break increases as a stellar population ages. Based on 
the figure, J s — K s > 1.3 should select galaxies at z > 2 
that are either dominated by an evolved stellar pop- 
ulation or are highly reddened by dust — the so-ca lled 
"distant red galaxies", or DRGs (|Franx et al.ll2003h . A 
number of DRGs have been spectroscopicall y confirmed 
van Dokkum et aT]l2003l : iKrTek et alJl2006aM at z > 2, 
and large photometric sa mples of DRGs are found to 
have 1.5 < z^ot < 3.5 (IForster-Schreiber et al.l 12004 
IPapovich etafll200a lOuadri et al.ll2006D . 

Because DRGs have a fairly broad redshift distribu- 
tion, the rest-frame properties of galaxies satisfying the 
color criterion to a given magnitude limit in a particular 
selection band change with redshift in three important 
ways. First, the limiting absolute magnitude in the selec- 
tion band becomes brighter with increasing redshift for 
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a fixed survey depth, probing sharply decreasing source 
densities at the bright end of the steep luminosity func- 
tion. Second, the rest wavelength of the selection band 
decreases with increasing redshift, probing wavelengths 
where the scatter in M/L\ is large. Finally, the rest- 
frame color — essentially the type of galaxy selected — 
changes with redshift because the Balmer/4000A break 
is narrow in wavelength compared to the spacing between 
the J s and K s filters and because the spectral slope is 
not the same on both sides of the break for galaxies older 
than ~ 100 Myr. Together, these effects make it very dif- 
ficult to compare DRG properties at different redshifts. 

The bottom panel of Fig. [T] demonstrates how splitting 
the J — K criterion into two should divide DRGs into two 
redshift bins, 

J s - H > 0.9 : z > 2 
H - K s > 0.9 : z > 3, (1) 

mitigating the problems described above that prevent di- 
rect analysis of the variation of red galaxy properties with 
redshift. The wavelength baselines of the two NIR colors 
are similar enough that the same color limit can be used 
for both criteria to select identical rest-frame powerlaw 
spectral slopes. The criteria of Equation [T] are adopted 
analagous to J s — K s > 1.3 to select against low-z inter- 
lopers, while the selection efficiency of the J s — H and 
H — K s criteria may be further enhanced by the fact that 
those colors are steeper functions of redshift at the low-z 
selection boundaries than J s — K s . 

Alternatively, one could select samples of galaxies 
based on their rest-frame properties estimated using dis- 
tances determined from the galaxies' photometric red- 
shifts. We note, however, that the z p hot — 2 spe c calibration 
is poorly determined at z > 3, and therefore relying on 
photometric redshifts alone introduces large uncertain- 
ties in the analysis at high redshift. Furthermore, by 
working in the observed frame, the results can be easily 
verified by others independent of photometric redshift or 
analysis techniques. 

3. DATA 

We use the deep optical+NI R photometry of the 
FIRES survey (jFranx et all 12000( 1 to select red galaxies 
at z > 2 based on the two NIR color criteria described 
above. Details of the data reduction and -ftf-selected 
source catalogs of the two fields of the survey, HDF-S (4.7 
arcmin 2 ) and MS 1 054-0 3 (26.3 arcmin 2 ), can be found i n 
lLabbe et al] ((2003) and IForster Schreiber et alj (|2006H . 
respectively. Briefly, the combined catalog of the two 
fields contains HST U 3Q0 B 45Q (HDFS-S), V<mhu (both 
fields), ground-based UBV (MS 1054-03) and ISAAC- 
J S HK S (both fields) photometry, along with photometric 
redshifts determined foll owing the procedure described 
by iRudnick et all (|200lL l2003t l. Details of the accuracy 
of the photometric reds hifts in these fields are given i n 
lLabbe et al] (|2003h and IForster Schreiber et al.l (|2006h . 
The combined catalog depth is limited by the shallower 
MS 1054-03 observations. At K s = 24.6, the combined 
catalog is ~ 90% complete and sources in the MS 1054- 
03 catalog have (S/N) K = 5-7. The FIRES dataset 
provides a unique opportunity to select red galaxies at 
z > 3.5 — even the brightest of which should still be quite 
faint in K — since there are no other currently available 
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Fig. 1. — Top: Evolution of J a — K s color with reds hift. The 
dashed line shows the DRG criterion of Franx et al. ( 2003) designed 
to select passively-evolving galaxies at z > 2. Bottom: J s — H 
(blue) and H — K s (red) vs. z. The dashed line indicates the 
selection criteria used in this Letter, which are analogous to the 
DRG color selection but that divide the DRG sample into two 
redshift bins. The shaded bands i ndicate the range of colors of 
dust-free Bruzual & Chariot (2003) passively evolving templates 
with ages between 0.25 and 1.0 Gyr. The thin lines correspond to 
a template with a constant star formation rate with age 0.1 Gyr 
and E(B — V) = 0.5, showing that moderately reddened starbursts 
at low redshift are not expected to significantly contaminate the 
z > 2 NIR-sclccted galaxy samples. 



surveys of comparable depth in all three JHK NIR fil- 
ters. 

4. DENSITIES 

From the combined FIRES catalog we find 18 sources 
that satisfy J s — H > 0.9 ; H < 23.4 and 23 sources with 
H - K s > 0.9 ; K s < 24.6. The limiting magnitude in 
H was chosen such that the rest-frame limiting magni- 
tude redward of the Balmer/4000A break is the same 
for both samples, and its value was determined based 
on the ratio of the luminosity distances at the median 
redshifts of the two samples. The number of selected 
sources correspond to combined (HDF-S-only) surface 
densities and Poisson errors of 0.58 ± 0.18 (0.63 ± 0.37) 
and 0.74±0.19 (0.42±0.30) arcmin^ 2 for the J s -H and 
H — K s selected samples, respectively. The photomet- 
ric redshift distributions of the NIR selected sources are 
shown in Fig. [2j The J s — H sample has z p hot = 2.4 ± 0.3 
(1-cr range) and 16/18 galaxies also satisfy J s — K a > 1.3. 
For the H — K s sample, z p hot = 3.9±1.0 and 15/23 galax- 
ies satisfy J s — K s > 1.3. 

If we consider comoving volumes bounded by tophat 
redshift distributions of 2 < z p hot < 3 and 3 < z p hot < 
4.5, the area-weighted space densities and associated 
Poisson errors of the J s — H and H — K s samples are 
1.5 ± 0.5 x 10~ 4 and 1.2 ± 0.4 x 10~ 4 Mpc -3 , respec- 
tively. Therefore, the space density of a flux-limited 
sample of red galaxies remains constant within the er- 
rors from (z) JH ~ 2.4 to (z) UK ~ 3.7. We note that 
the total survey area discussed here is relatively small 
and that our result is likely subject to cosmic variance, 
especially in light of recent studies that s how that red 
galaxies at z > 2 are strongly clustered (jDaddi et al.l 
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Fig. 2. — Photometric redshift distribution of galaxies in the 
FIRES fields with J a - H > 0.9; H < 23.4 (blue) and H — K a > 
0.9; K 3 < 24.6 (red). Although the samples show a small overlap 
in redshift space, no galaxy meets both selection criteria. For com- 
parison, the dotted line shows the redshift distribution of galaxies 
satisfying J s — K s > 1.3 and K s < 24.6. 



[20031: iQuadri et alJl2006h . 

5. REST FRAME SEDS 

Athough there is no appreciable change in the num- 
ber of galaxies selected to have strong Balmer/4000 A 
breaks from z ~ 2.4 to z ~ 3.7, their properties are 
quite different. Fig. [3] shows the spectral energy distri- 
butions (SEDs) of the two galaxy samples shifted to the 
rest-frame. The J s — H galaxies typically have red rest- 
frame UV-optical colors and a fairly flat rest-UV spec- 
trum, consistent with pr evious studies of DRGs in th e 
redshift range 2 < z < 3 (jForster-Schreiber et al.ll2004f h 
In contrast, the higher-redshift H — K s galaxies gener- 
ally have blue UV-optical colors. The spectral slopes 
of the two samples through the Balmer/4000 A break 
are similar for the two samples, confirming that the NIR 
color criteria proposed here select galaxies with similar 
(U - B) icst colors over 2 < z < 4.5. 

We quantify the spectral shapes of the S EDs using the 
rest-f rame UV power-law slope, F\ o c (ICalzetti et al. 
I1994D . measured from a best-fit iBruzual fc Chariot 
(2003) template with an exponentially decaying star for- 
mation rate (r = 300 Myr) and solar metallicity. The 
template fits to the broadband photometry hold the red- 
shift fixed to the catalog z p hot values, allow ages between 
0.1 Myr and the age of the universe at z p hot and al- 
low Ay = — 3 m ag following the extinction law of 
ICalzetti et al.l (|2000D . Correc tions fo r Lyq forest ab- 
sorption are applied following iMadaul ((1995). The dis- 
tributions of [3 for the two galaxy samples are shown 
in Fig. [31 The distribution is quite flat for the J s — H 
sample — similar to the di stribution seen for a large sam- 
ple of massive DRGs by Ivan Dokkum et all ((2006). In 
contrast, the distribution of (3 for the H — K s sample 
sh ows a peak at ~ —2 , value s similar to those found 
by lAdelberger fc Steidell (|2000f ) for UV-selected galax- 
ies and to the sampl e of massive Lyman break galaxies 
(LBGs) discussed by Ivan Dokkum et all (|2006l ). 

Of the 12 galaxies in the H — K sample that have 
Zphot in the range 2.7 < z < 3.4 or 3.9 < z < 4.5, 10 
have synthetic U n G1ZI colors integrated from the best-fit 
templates that satisfy the U or G dr opout LBG color cr i- 
teria at those redshifts proposed bv lSteidel et al.l (|1999f ). 
However, 8 of those 10 galaxies with LBG colors have 
1Z > 25.5, too faint to be included in typical spectro- 
scopic samples of LBGs. 
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Fig. 3. — Rest-frame SEDs of the J s — H (blue circles) and 
H—K a (red diamonds) galaxy samples limited to 2 < z p i lot < 3 and 
3 < Zphot < 4.5, respectively. The SEDs are normalized to the flux 
at A rcs t = 3700 A determined from a linear interpolation between 
the two nearest filters in the rest frame. The solid red and blue 
lines indicate a running median of the 10 neighboring points for the 
two samples. An unreddened 1 Gyr old T300 template is shown for 
reference. The similarity of the SED slopes at the Balmer/4000 A 
break demonstrates how the two color criteria are matched to select 
similar rest-frame spectral shapes at two different redshifts. Inset: 
distribution of the synthetic rest-frame UV spectral slope, f). The 
thin histograms correspond to the entire samples, while the filled 
histograms are for sources that fall within the 2 < z p hot < 3 and 
3 < Zphot < 4.5 comparison ranges. With few exceptions, the 
higher redshift galaxies in the H — K B sample have UV-optical 
colors that are significantly bluer than those of the J B — H selected 
galaxies at lower redshift. 



6. DISCUSSION 

We have shown that we can efficiently select z ~ 3.7 
galaxies in the near-IR with the simple color criterion 
H — K > 0.9. The samples described here indicate that 
the rest-frame UV-optical SEDs of galaxies selected to 
have strong Balmer/4000 A breaks are significantly dif- 
ferent at z ~ 2.4 and z ~ 3.7: galaxies in the higher 
redshift sample have a median NUV/optical flux ratio 
2 — 4 times greater than that of the galaxies at z ~ 2.4. 
Finding evolution in the properties of galaxies over the 
~ 1 Gyr between z — 2.4 — 3.7, which at the distant end 
is only 1.7 Gyr after the Big Bang, is in itself not surpris- 
ing, as the spectral evolution is rapid at these redshifts 
for galaxies with a broad range of formation redshifts and 
subsequent star formation histories. What is interest- 
ing is that the galaxies in both samples were selected to 
have similarly strong Balmer/4000 A breaks, indicating 
the presence of an evolved stellar population that itself 
would not be a likely source for the strong NUV compo- 
nent of the z ~ 3.7 SEDs. A two-burst model whose op- 
tical SED is dominated by an evolved stellar population 
but that also contains a young component that supplies 
the UV flux could explain the z ~ 3.7 SEDs. Though 
two-component model fits are beyond the scope of this 
Letter, there have been other observations of red galax- 
ies at high-z suggesting that composite populations are 
appropriate, both from SED modelling (|Yan et al.ll2004l ) 
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and from obse rvations of distin ct UV and optical galaxy 
morphologies (To ft et aT1l2005h of such galaxies. 

Our T300 template fits suggest that dust is the primary 
source of the difference in spectral shape shown in Fig(3j 
Both samples have a median template age of ~ 1 Gyr, 
while the median dust extinction decreases from Ay — 1 
to 0.2 mag going from the J s — H to the H — K s sam- 
ple. In general one expects the dust content of galaxies, 
along with the metal content, to increase with time, qual- 
itatively consistent with the analysis presented here. It 
is difficult to quantitatively compare our results to theo- 
retical models of galaxy formation since such models typ- 
ically rely on ad ho c treatments of dust absorption (e.g. 
ICroton et al.l [2006) . Interestingly, our results may be 
qualitatively consistent with the redshift distribution of 
submillimeter-selected galaxies. Although still quite un- 
certain, there is evidence that the number of very dusty, 
luminou s galaxies drops sig nificantly from z ~ 2.4 to 
z ~ 3.7 (|Chapman et al.ll2005l ). 

The normalization of our population synthesis fits pro- 
vides a rough estimate of the stellar mass of each galaxy 
in the sample. With our photometry sampling only the 
rest-frame UV-optical light of the galaxies in our sam- 
ple at z > 2, the stellar mass fits are uncertain to fac- 
tors of > 2 due to uncertainties in z p hot and in the IMF 
and to model degeneracies between age, dust, metallic- 
ity, and star formation history. With those caveats in 
mind, our template fits imply that the median stellar 
mass of red galaxies decreases by a factor of ~ 5 from 
z ~ 2.4 to z ~ 3.7. While the uncertainties are large for 
the masses of individual galaxies, a Mann- Whitney test 
on the distribution of masses suggests that the difference 
in the median masses of th e two samples is significant 
at the 99% confidence level. lErb et aLl (|2006l ) observe a 
similar trend in the mass of LBGs: the average dynam- 
ical and stellar masses of z ~ 3 LBGs are a factor of 2 
smaller than for LBGs at z ~ 2. We note here that the 
H — K galaxies are not necessarily direct progenitors of 
the J — H galaxies, just as LBGs at z — 4 are not neces- 
sarily progenitors of LBGs at z = 2. Many of the H — K 
galaxies could fade below our magnitude limit after ~ 1 
Gyr; conversely, many of the J — H galaxies could have 
been much bluer 1 Gyr previously. 

Since the space densities of the J s — H and H — K s sam- 



ples are statistically equivalent, a decrease in the median 
stellar mass in the higher redshift sample, if real, would 
indicate a decrease in the stellar mass density of galaxies 
with evolved stellar populations . This m ay be consistent 
with the results of iKriek et al.l (|2006bh . who find that 
the ages of apparently passive galaxies at z ~ 2.3 (which 
make up 45% of their if-selected sample) are typically 
< 1 Gyr. It seems unlikely that many of the z > 3 pro- 
genitors of these galaxies were already "red and dead" . 
On the other hand, this result may be difficult to rec- 
oncile with the existence of a significant population of 
M* > 10 11 M© galaxies a t z > 6, as may be im plied 
by the source describ ed bvlMobasher et alJ (12 005). Fur- 
thermore, the b est fit[Bruzual &: Charlotl (|2003l ) z = 6.5 
template of the iMobasher et al.l (|2005f) source has (3^2 
and would be an outlier even at z ~ 3.7 compared to the 
sources in our H — K sample. 

Clearly, much further work is required to fully under- 
stand how the properties of red galaxies change with time 
at z > 2. The differences shown in Fig. [3] are model in- 
dependent, to the extent that the photometric redshifts 
approximate the true redshifts, but the results above 
based on template fits are quite uncertain. The addition 
of Spitzer photometry would better constrain the ste l- 
lar mass contained in these galaxies ([Wuvts et alj [2006) . 
The brightest galaxies in the H — K s sample may be 
within reach of NIR spectroscopy that could precisely de- 
termine redshifts and model stellar populations based on 
the prominent Balmer/4000A break s, as has been don e 
quite effectively for DRGs at z ~ 2.5 (jKriek et all2006a| ). 
Finally we note that the UKIDSS Ultra Deep Survey is 
planned to be ~0.2 mag deeper than our adopted K s 
limit over an area ~ 90 times that of FIRES, which would 
vastly increase the sample sizes of galaxies selected as de- 
scribed here. 
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